£V052?015 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

APPLICATION FOR LETTERS PATENT 



In- Vehicle Audio Browser System Having a 
Common Usability Model 



Inventor(s): 
Mikky Anderson 
Bruce L. Johnson 
William Sproule 
Polita Huff 



ATTORNEY'S DOCKET NO. MS1-869US 



TECHNICAL FIELD 

This invention relates to an audio browser for vehicles and, more 
particularly, to the application of a common usability model to multiple modes of 
operation of the vehicle car stereo. 

BACKGROUND OF THE INVENTION 

Many car stereo systems (including vehicle computer systems and vehicle 
entertainment systems) include multiple bands, such as AM, FM1, FM2, and CD. 
The selected band represents the operating state of the car stereo (e.g., receiving 
AM stations, receiving FM stations, or playing an audio CD). After selecting a 
particular band, the user selects a preset button to select between radio stations (or 
CD in a CD Changer) or a tuning buttons (seek and/or scan) to tune a particular 
radio station (or select a particular CD track). 

Certain vehicle computer systems provide the opportunity to add new 
features and functions to existing car stereo systems. For example, a vehicle 
computer system may provide navigational functions in addition to conventional 
car stereo functions. 

As more functions are added to car stereos (or other vehicle computer 
systems), it may be necessary to add additional buttons to the car stereo to support 
the new functions. It is important to minimize the number of changes to the 
current car stereo model to allow the user the easiest adoption path for the new 
functionality and minimize the negative effects of putting more secondary 
activities into the car environment. The primary task of a driver of a vehicle is the 
driving of the vehicle, not manipulating the car stereo controls. Adding a 
significant number of new buttons to support the new car stereo functions may 
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distract the driver from the primary task of driving the vehicle. Therefore it is 
important to provide a usability model that is familiar to the user of the car stereo 
to minimize distractions while driving the vehicle. 

SUMMARY OF THE INVENTION 

The systems and methods described herein provide a common usability 
model for multiple modes of operation of a car stereo system. The basis of the 
invention is the extension of the current car stereo into a more flexible "audio 
browsing" model. The common usability model extends the typical car stereo 
usability model with new functionality while maintaining the typical car stereo 
functions that have been learned by many vehicle users. By maintaining typical 
car stereo functions, users can more easily interact with a more intelligent device 
because they already know how to perform, for example, the radio and CD player 
functions. The addition of a small number of buttons to implement new car stereo 
functionality minimizes the differences between the new audio browser and 
conventional car stereos to the user of the new audio browser. 

According to one aspect of the invention, an audio browser includes a first 
set of buttons that select a preset item. A second button selects between a set of 
primary audio control bands and a set of conditional audio control bands. A third 
button selects a band from the set of bands selected by the second button. 

Another embodiment of the invention includes a fourth button that activates 
a function that varies based on the selected band. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The same reference numerals are used throughout the drawings to reference 
like components and features. 

Fig. 1 is a diagrammatic illustration of an in- vehicle audio browser. 

Fig. 2 is a flow diagram illustrating an embodiment of a procedure for 
handling operation of the "BND" button. 

Figs. 3-8 illustrate a car stereo faceplate in different modes of operation. 

DETAILED DESCRIPTION 

Fig. 1 shows an example implementation of an in-vehicle audio browser 20. 
The audio browser 20 has a centralized computer 21 coupled to various peripheral 
devices, including speakers 25, vehicle battery 26, and antenna(s) 27. The 
computer 21 is assembled in a housing 28 that is sized to be mounted in a vehicle 
dashboard, similar to a conventional car stereo. Preferably, the housing 28 has a 
form factor of a single DIN (Deutsche Industry Normen). But, it possibly could be 
housed in a 2 DIN unit or other special form factor for an OEM. The methods and 
systems described herein may be applied to any type of vehicle computer system, 
vehicle entertainment system, or vehicle stereo system. In a particular 
embodiment, the in-vehicle audio browser is a car stereo system. 

The computer 21 runs an open platform operating system which supports 
multiple applications. Using an open platform operating system and an open 
computer system architecture, various software applications and hardware 
peripherals can be produced by independent vendors and subsequently installed by 
the vehicle user after purchase of the vehicle. This is advantageous in that the 
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software applications do not need to be dedicated to specially designed embedded 

systems. The open hardware architecture is preferably running a multitasking 

® 

operating system. One preferred operating system is a Windows brand operating 
system sold by Microsoft Corporation, such as "Windows XP™", "Windows 
NT®", "Windows CE™", or other derivative versions of Windows®. A 
multitasking operating system allows simultaneous execution of multiple 
applications. 

The computer 21 includes at least one storage media which permits the 
vehicle user to store and transfer data (i.e. audio content) and possible new 
programs. One aspect of the invention is the ability to introduce new audio content 
into the in- vehicle environment. The purpose of the storage media component is to 
allow for the transportation of audio content in a format that can be played back 
and navigated by the audio browser. The storage media must either be removable 
or have some other mechanism (such as wireless access) for update. In the 
illustrated implementation, the computer 21 has a CD ROM (or DVD-ROM) drive 
29 which reads application-related CDs, as well as musical, video, game, or other 
types of entertainment CDs. In this manner, the CD ROM drive 29 performs a 
dual role of storage drive and entertainment player. A CD can then be used to 
transport the audio content to the audio browser. Also, a hard disk drive (not 
shown in Fig. 1) is included on the computer module which can be used for storing 
both application programs and user data. In combination with an optional 802.1 lx 
interface 24 the hard disk drive can have audio content wirelessly transported to 
the audio browser. 802.1 lx represents a family of IEEE standards for wireless 
networks used for the wireless communication of data between various devices. 
Alternatively, other wireless communication standards may be used to 
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communicate data between the audio browser 20 and another computing device, 
such as a personal computer providing data to and from the audio browser. 

The computer 21 has an optional smart card reader 31, and dual PCMCIA 
card sockets 32 which accept PCMCIA card types II and III or CF cards. 
Hereinafter, the acronym "PC-Card" will be used in place of the acronym 
"PCMCIA." The smart card and/or any bulk storage PC-Card (memory or hard 
drive) can also be used to transport audio content to the audio browser. 

The storage drives are mounted in a stationary base unit 33 of housing 28. 
The base unit 33 is constructed and sized to be fixedly mounted in the dashboard. 
The housing 28 also has a faceplate 34 which is pivotally mounted to the front of 
the base unit 33. The faceplate can be rotated to permit easy and convenient 
access to the storage drives. It is possible to build an audio browser without a 
pivoting faceplate, but there still has to be a way to access to the removable storage 
media. This could be done by having a CF card reader mounted vertically on the 
faceplate, or having only 802.1 lx access to an internal hard drive. 

Faceplate 34 functions as an operator interface, having a keypad 35 and a 
display 36. The faceplate is mountable for viewing by a vehicle operator. The 
display 36 is preferably a backlit LCD panel having a rectangular array of pixels 
that are individually selectable for illumination or display. However, it is also 
possible to have only a set of alpha-numeric (text) enunciator for the display. An 
enunciator based display will have to have a defined set of areas to display band, 
preset, and song information. An exemplary set of areas are: 3 characters band 
area, 1 character preset number area, 10 character preset title area, and 1 5 character 
song information area. 
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The LCD panel is preferably a medium-resolution, bit-mapped display 
system having at least 10,000 pixels. In the described implementation, the array of 
pixels has a size of at least 256 x 64 pixels, which is quite limited in comparison to 
most desktop displays. The operating system of computer 21 interacts with 
faceplate keypad 35 and faceplate display 36 as peripheral devices when the 
faceplate 34 is attached to the housing 28. The operating system will allow for and 
abstract display models for both the enunciator based display type and bitmap 
based display. The keypad 35 includes multiple number keys, labeled "1" through 
"6". 

The faceplate 34 has a "Rev" button 40 that represents a reverse (or rewind) 
function, a "Play/Pause" button 42 that toggles operation between play and pause 
functions, and a "Fwd" button 44 that represent a forward (or advance) function. 
The faceplate 34 also has a volume control input 38, an "ACT" button 46 that 
represents an "action" function, a "SRC" button 48 that represents a "source" 
function, and a "BND" button 50 that represents a "band" function. The operation 
of the action, source, and band functions are discussed in greater detail below. 

A CD slot 52 allows a CD, such as a music CD, to be inserted into the CD 
ROM drive 29. Alternatively, a CD may be inserted into CD ROM drive 29 by 
pivoting or otherwise moving faceplate 34 such that the CD ROM drive is 
accessible by the user. A power button 54 toggles power to the vehicle computer 
system 20. 

In general, the audio browser 20 is used to integrate new audio content and 
sources onto one user model and one open platform hardware and software 
architecture. The basic mode of operation is the playback of audio content that has 
arrived at the audio browser via the required removable media. This audio content 
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has been collected and organized on some remote device (such as a personal 
computer) and delivered to the audio browser for playback. The audio content will 
include configuration information to instruct the audio browser as to which audio 
content is associated with which band/preset content and if there are special 
instructions needed for the behavior of the other buttons on the faceplate. 

The configuration file is represented in an XML manifest. The manifest 
contains exemplary information about the behavior and type for each band/preset. 

Here is an example of the XML: 



<?xml version="l . 0" encoding="utf -8 " ?> 
<Manifest Version=" 0 . 5 " ID="2452346234" 
Name= "MikkyA_Stuf f 11 > 

<Bands Cur rent Band= " FM " > 

<Band ID="FM" Title="FM" Type=" radio" 

CurrentPreset = " 1 " > 

<Preset ID="88.5" Title="KPLU 88.5" 

Setting= "1 11 Freq= " FM : 8 8 . 5 " /> 

<Preset ID="96.5" Title= "KPNT 96.5" 
Setting="2" Freq="FM : 96 . 5 "/> 
</Band> 

<Band ID="WM1" Title="WMl" Type="playlist" 
CurrentPreset= " 2 " > 

<Preset ID="NPR-ME" Tit le= "Morning 
Edition" Setting="l" Src= "BandO\PresetO\PresetO . ASX" 
Currentlndex= " " CurrentTime= " 11 / > 

<Preset ID="Market" Title="Market Place" 
Setting="3" Src= "BandO\Preset2\Preset2 .ASX" 
Currentlndex=" " CurrentTime=" "/> 

<Preset ID="CBC-W@6" Title="CBC" 
Setting="4" Src= "BandO\Preset3\Preset3 .ASX" 
Current Index = " " Current Time= " " / > 
</Band> 

<Band ID="WRK" Title="WRK" Type= "playlist " > 
<Preset ID="OutlookToday" 
Tit le= "Out lookToday " Sett ing= " 1 " 

Src="OutlookToday\OutlookToday.asx" Current Index- " " 
CurrentTime= " " / > 
</Band> 
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<Band ID="PT n Title=" Phone Tasks" 
Type= "phonetask" > 

<Preset ID=" Phone Mail" Title=" Phone 
Mail" Setting="l" Src="Phone\PhoneMail\PhoneMail . asx" 
Current Index= " " CurrentTime= " " / > 

<Preset ID="Home Tasks" Title="Home 

Tasks" Settings "2" 

Src=" Phone\PhoneTaskshome\PhoneTaskshome . asx" 
Currentlndex= " 11 CurrentTime= " " / > 

<Preset ID="Work Tasks" Titles "Work 

Tasks" Setting="3" 

Src= " Phone\phonetaskswork\phonetaskswork . asx" 
Current Index=" " CurrentTime= " "/> 
</Band> 

<Band ID="NT1" Title= "Navigation" 
Type=" direction" > 

<Preset ID="To Airport" Title="To 
Airport" Settings 11 1 11 Src="nav\toairport\toairport . asx" 
Current Index= " " Curr entTime= ""/> 

<Preset ID="To Gas Station" Title="To Gas 

Station" Setting="2" 

Src="nav\togasstation\togasstation.asx" Current Index= " " 

CurrentTitne= " " / > 

<Preset ID="To Museum of Flight" 
Title="To Museum of Flight" Setting="3" 
Src="Nav\tomuseumofflight\tomuseumof flight .asx" 

Current Index= " " CurrentTime- "" / > 
</Band> 

<Band ID="CL" Title= " Contact List" 

Type= " contacts " > 

<Preset ID="Home" Title="Home Numbers" 
Setting= "1" Src= " Contact s\Home. asx" Current Index= " " 

CurrentTime= " " / > 

<Preset ID="Work" Title="Work Numbers" 
Setting="2" Src= " Contact s\Work . asx" Current Index= " " 
CurrentTime= " " / > 
< /Band> 
</ Bands > 
</Manif est> 



This example manifest is one possible format that can be used to convey the 
configuration information from a personal computer or service or even between 
different audio browsers in different vehicles. With the flexibly of XML, this 
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format can easily change to meet the needs for any new bands that are created in 
the future. 

In the embodiment discussed above, the faceplate 34 is pivotally mounted 
to the base unit 33. In alternate embodiments, faceplate 34 may be detached from 
the base unit 33. In other embodiments, faceplate 34 is permanently fixed to the 
base unit 33. 

As shown in Fig. 1, many of the buttons on faceplate 34 have been found on 
car radios for many years. For example, the keypad 35 contains various radio 
station presets. Additionally, the "Rev", "Play/Pause", and "Fwd" buttons should 
be familiar to most radio users. However, the "ACT" button has not been included 
on previous car stereos and provides additional functionality for the new car stereo 
system shown in Fig. 1 . 

The BND button (Fig. 1) causes the car stereo to cycle through the various 
bands supported by the car stereo. In a particular embodiment, the car stereo has 
the following bands: AM, FM, CD (Audio CD), WM (Windows Media), PT 
(Phone Tasks), NT (Navigation Tasks), and CL (Contact Lists). The selected band 
identifies the current function of the car stereo, such as playing the selected FM 
radio station or providing navigation instructions to a selected destination. 

The bands are divided into two different classes: primary audio control and 
conditional audio control. Primary audio control bands automatically take over the 
audio output of the audio browser when they are selected. However, conditional 
audio control bands do not immediately take over the audio output of the audio 
browser, thereby not interrupting the audio signal listened to by the user. In a 
particular embodiment, AM, FM, CD, and WM are primary audio control bands. 
Switching to one of these primary audio control bands causes the car stereo system 
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to switch to the source's current state (e.g., a preset radio station or CD track) and 
start playing the appropriate audio signal. PT, NT and CL are examples of 
conditional audio control bands. Switching to one of these conditional bands does 
not interrupt the current audio signal playing from the last selected primary band. 
If some action on this conditional band requires an audio output (such as providing 
audible directions, making a cellular phone call, or providing an audible task), then 
the primary audio will be paused or muted until the audio output is finished being 
used by the conditional band. When the conditional band function is finished 
using the audio output, the audio is returned to the primary band and the audio 
output is resumed. 

In one embodiment, the "SRC" button (Fig. 1) on the faceplate switches 
between primary and conditional band types and the "BND" button switches 
between bands within the current type. In another embodiment, the "BND" button 
switches between all band types. 

Fig. 2 is a flow diagram illustrating an embodiment of a procedure 200 for 
handling operation of the "BND" button. Initially, a user selects a particular band 
on the car stereo using the BND button on the faceplate (block 202). The 
functions associated with the other buttons on the faceplate are modified based on 
the selected band (block 204). The user then manipulates the other buttons on the 
faceplate to perform the desired function (block 206). The car stereo performs the 
selected function (block 208). The procedure then determines whether the user has 
pressed any buttons on the faceplate (block 210). If the user has not pressed any 
buttons, the operation of the car stereo continues unchanged until one of the 
buttons is pressed. If the user presses a button, the procedure determines whether 
the button pressed was the BND button (block 212). If the button was the BND 
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button, then the procedure returns to block 204 to modify the functions associated 
with the other buttons on the faceplate based on the new band selection. If the 
button pressed was not the BND button, then the procedure returns to block 208, 
where the car stereo performs the selected function. 

Once a particular band has been selected, the behavior of the other buttons 
on the faceplate changes to the appropriate behavior for the selected band type. 
The appropriate behavior of the various buttons for each band type is discussed 
8 1| below. 

Fig. 3 illustrates a car stereo faceplate in the FM1 mode. The faceplate 
shown in Fig. 3 is substantially the same as faceplate 34 shown in Fig. 1. The 
faceplate display indicates that the first preset has been selected (indicated by 
12 1| "1:"), which is radio station KNDD having a frequency of 107.7. In the FM1 
mode, the buttons on the faceplate perform the following functions: 
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1-6 Presets: Press: Switches to a preset radio frequency. 

Press & Hold: Sets the preset to the current radio frequency. 
Reverse: Press: Scans backwards through the radio frequencies. 

Press & Hold: Scans backward through the cache of the 

currently playing radio frequency. 
Forward: Press: Scans forward through the radio frequencies. 

Press & Hold: If the radio frequency currently playing was 

paused then it scans forward through the cache of the 

currently playing radio frequency. 
Play/Pause: Press: Pauses or restarts radio broadcast by saving the audio 



25 stream to storage. 
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Action: Press: Saves the current playing song or small historical time 
segment (the last 5 minutes and the next five minutes). 

Similar functions are associated with the buttons in other radio band modes (e.g., 
FM2, FM3, and AM). 

Fig. 4 illustrates a car stereo faceplate in the CD mode. The faceplate 
display indicates that the first CD in a CD changer has been selected, which is an 
audio CD containing music from the Beatles 5 album "Abbey Road". In the CD 
mode, the buttons on the faceplate perform the following functions: 

1-6 Presets: Press: Switches to a CD within a CD changer 
Reverse: Press: Skips to previous track on the current CD. 

Press & Hold: Scans backward within the current track on the 

current CD. 

Forward: Press: Skips to next track on the current CD. 

Press & Hold: Scans forward within the current track on the 
current CD. 

Play/Pause: Press: Pauses or plays the current track on the current CD. 

Action: Press: Saves the current playing track to storage and places 
the song in the next available preset track on a WM band. 
Press & Hold: Save the current playing CD to storage and 
places the CD in the next available preset on a WM band. 

Fig. 5 illustrates a car stereo faceplate in the WM (Windows Media) mode. 
The WM band presents represent an audio playlist The WM band may also be 



lee & Hayes PLLC 



12 



Any Docket No MS1-869US 



referred to as a digital media band. The playlist could represent a saved CD, a 
random set of 1 0 songs from a musical collection or songs from a radio collection. 
The faceplate display indicates that the first playlist has been selected, which is a 
morning issue of the NPR broadcast. In the WM mode, the buttons on the 
faceplate perform the following functions: 



1-6 Presets: Press: Switches to a preset playlist that has either been saved 
(from radio or CD) or loaded via (wireless or removable) 
storage medium. 

Reverse: Press: Skips to previous track in the current playlist.. 

Press & Hold: Scans backward within the current track in the 
current playlist. 

Forward: Press: Skips to next track in the current playlist. 

Press & Hold: Scans forward within the current track in the 
current playlist. 

Play/Pause: Press: Pauses or plays the current track in the current playlist. 
Action: No function for this band. 



Fig. 6 illustrates a car stereo faceplate in the PT (Phone Task) mode. The 
faceplate display indicates that the first phone task has been selected, which is a 
phone task to cancel a dentist appointment. In one embodiment, phone tasks are 
personal information manager (PIM) tasks that require a phone call to complete the 
task. Phone tasks contain a simple set of text reminders as to what needs to be 
done with the task and an associated phone number to call to complete the task. In 
the PT mode, the buttons on the faceplate perform the following functions: 
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1-6 Presets: Press: Selects a phone task that has been loaded via (wireless 
or removable) storage medium. The first line of the text 
description of the task is placed on the display. The primary 
audio output is not interrupted. 

Reverse: Press: Display is changed to previous line of text description 
of the current task. 

Press & Hold: Display is changed to the first line of the text 
description of the current task. 
Forward: Press: Display is changed to the next line of the text 
description of the current task. 

Press & Hold: Display is changed to the last line of the text 
description of the current task. 
Play/Pause: Press: Translates the description of the current task from text 
to speech. Interrupts the current primary audio output while 
the translation is playing and resumes once the translation is 
completed. 

Action: Press: Dials the phone number associated with the current 
task. Interrupts the primary audio output while the call is 
being made and resumes once it is completed. If a call was in 
progress, then the phone is hung up. 
Press & Hold: Marks the task as completed. 



Fig. 7 illustrates a car stereo faceplate in the NT (Navigation Tasks) mode. 
The faceplate display indicates that the first step in navigating to the desired 
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destination (Turn Left on 148th Street). Navigation tasks is a list of directions that 
are used to get from one point to another. In the NT mode, the buttons on the 
faceplate perform the following functions: 



1-6 Presets: Press: Selects a navigation task that has been loaded via 
(wireless or removable) storage medium. The first line of the 
text direction of the task is placed on the display. The primary 
audio output is not interrupted. 

Reverse: Press: Display is changed to the previous line of the text 
direction of the current task. 

Press & Hold: Display is changed to the first line of the text 
direction of the current task. 
Forward: Press: Display is changed to the next line of text direction of 
the current task. 

Press & Hold: Display is changed to the last line of the text 

direction of the current task. 
Play/Pause: Press: Translates the current line of the text direction of the 

current task from text to speech. Interrupts the current 

primary audio output while the translation is playing and 

resumes once the translation is complete. 
Action: No function for this band. 



Fig. 8 illustrates a car stereo faceplate in the CL (Contact List) mode. The 
faceplate display indicates that the first preset (1) in has been selected (Sherry's 



Lee & Hayes PLLC 



15 



Atty Docket No MSI-869US 



home phone number). In the CL mode, the buttons on the faceplate perform the 
following functions: 



1-6 Presets: Press: Selects a preset contact from the list. The name and 

phone number of the contact is placed on the display. The 

primary audio output is not interrupted. 

Press & Hold: Saves the current contact to the current preset. 
Reverse: Press: Skips to the previous contact in the entire contact list. 

Press & Hold: Skips backwards 10 contacts. 
Forward: Press: Skips to the next contact in the entire contact list.. 

Press & Hold: Skips forwards 10 contacts. 
Play/Pause: Press: Translates the contact name from text to speech. 

Interrupts the current primary audio output while the 

translation is playing and resumes when the translation is 

completed. 

Action: Press: Dials the currently selected phone number. Interrupts 
the current primary audio output while the call is being made 
and resumes once it is completed. If a call was in process 
then the phone is hung up. 

The various bands and functions discussed above are provided by way of 
example. A particular car stereo system may offer any number of different bands 
and functions, including bands and functions not discussed herein. 

A particular audio browser includes a memory capable of storing an 
operating system and one or more application programs that execute on one or 
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more microprocessors. The microprocessor (s) are programmed by means of 
instructions stored at different times in various computer-readable storage media of 
the device. This storage media may include, for example, smart cards, a disk 
drive, or other volatile or non- volatile storage mechanism. Application programs 
are typically installed or loaded into the secondary memory of a computer. At 
execution, the application programs are loaded at least partially into the computer's 
primary electronic memory. The invention described herein includes these and 
other various types of computer-readable storage media when such media contain 
instructions or programs for implementing the steps and features described herein 
in conjunction with a microprocessor or other data processor. The invention also 
includes the computer and other devices themselves when programmed according 
to the methods and techniques described herein. 

Although the invention has been described in language specific to structural 
features and/or methodological steps, it is to be understood that the invention 
defined in the appended claims is not necessarily limited to the specific features or 
steps described. Rather, the specific features and steps are disclosed as preferred 
forms of implementing the claimed invention. 



Lee & Hayes, PLLC 



17 



Atty Docket No MS1-869US 



